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I .  OVERVIEW 


The  Defease  Logistics  Agency's  (DLA's)  central  design  activity,  the  DLA 
Systems  Automation  Center  (DSAC),  is  beset  with  large  development  work  back¬ 
logs  and  extended  systems  development  schedules.  Increasing  development 
workloads  and  an  apparently  insufficient  number  of  personnel  to  handle  them 
have  precipitated  the  problem.  One  possible  solution,  to  reduce  backlogs  and 
shorten  development  schedules,  is  to  contract  DSAC  work  to  commercial  systems 
development  organizations.  Another  is  to  increase  internal  DSAC  systems 
development  productivity. 

We  conclude  that  both  solutions  should  be  pursued.  DSAC  can  use  con¬ 
tractors  for  some  of  its  work,  and  it  can  increase  its  productivity. 

Conditions  which  make  contracting  feasible  can  be  stated  as  criteria. 
Criteria  have  been  developed  for  the  various  types  and  phases  of  DSAC  develop¬ 
ment  work--for  systems  development  projects  that  have  not  yet  been  imple¬ 
mented,  for  maintenance  work  required  for  systems  currently  in  operation,  and 
for  the  technical  assistance  functions  that  support  both  new  development  and 
maintenance  work.  The  criteria  address  1)  the  adequacy  of  systems  require¬ 
ments  definitions  and  program  specifications,  2)  the  functional  knowledge 
required  of  systems  analysts  to  effectively  design  new  DLA  systems  or  modify 
current  ones,  3)  the  program  design  knowledge  and  programming  expertise  re¬ 
quired  by  analysts  and  programmers,  4)  the  complexity  of  the  new  development 
and  maintenance  work,  and  5)  the  measures  required  for  testing  new  or  modified 
systems . 

Applying  the  criteria,  we  find  that: 

-  a  significant  amount  (approximately  40%)  of  planned  development  work 
can  be  performed  by  outside  contractors . 
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-  approximately  43%  of  DSAC’s  telecommunications  functions  and  38%  of 
its  technical  support  functions  have  contractible  elements  which  can 
be  performed  by  outside  organizations. 

-  very  little  (under  10%)  of  DSAC's  systems  maintenance  work  can  be 
performed  by  contractors. 

*  little  (only  15%)  of  DSAC's  current  workload  can  be  performed  by 
contractors  because  most  of  it  is  for  systems  maintenance,  but  the 
balance  is  expected  to  shift  substantially  in  favor  of  new  development 
activity. 

Computer  programming  appears  to  be  the  most  contractible  of  all  develop¬ 
ment  activities  at  DSAC.  DSAC  should  contract  for  outside  programming  as¬ 
sistance  for  all  of  its  development  sites.  It  should  also  obtain  assistance 
from  outside  organizations  which  provide  services  in  conceptual  systems  analy¬ 
sis  and  design  in  order  for  DLA  to  take  full  advantage  of  the  most  up-to-date 
software  and  computer  systems  technology  available. 

To  facilitate  these  actions,  DSAC  should  establish  and  administer  a 
contract  coordination  function. 

In  order  to  increase  its  own  internal  productivity,  DSAC  should 

-  augment  its  computer  equipment  to  provide  adequate  on-line  program 
compiling  and  testing  capabilities. 

-  identify,  test,  and  use  application  generators  and  automated  design 
software. 

-  update  standards  for  programming  languages  and  application  software 
for  use  in  the  development  of  new  systems. 


II.  CRITERIA  FOR  CONTRACTING  DSAC  WORKLOADS 


A  description  of  the  criteria  to  be  used  by  DSAC  in  deciding  whether  to 
place  systems  development  work  with  outside  organizations  is  presented  in  this 
section.  They  are  more  fully  described  and  defined  in  terms  of  their  applica¬ 
tion  to  DSAC  development  work  in  a  series  of  step-by-step  procedures  in  Ap¬ 
pendix  A,  "Criteria  for  Contract  Support  Decisions." 

For  convenience  in  their  application,  the  criteria  are  grouped  into  three 
categories  of  DSAC  systems  development  activity: 

-  New  Systems  Development  Work.  Application  systems  work  which  has  been 
planned  and/or  approved  for  DSAC's  systems  development  activity.  This 
work  consists  of  the  design  of  new  systems  and  their  programming  and 
testing  for  DLA  users. 

-  Systems  Maintenance  Work.  Application  systems  work  which  is  under¬ 
taken  to  modify/ imp rove  current  systems  for  users.  This  work  includes 
the  redesign  of  existing  applications,  their  reprogramming/ 
modification  and  testing. 

-  Technical  Assistance.  Development  work  in  support  of  both  new  devel¬ 
opment  and  systems  maintenance  work,  specifically  the  DSAC  telecom¬ 
munications  hardware  and  software  development  activities  and  the 
activities  of  DSAC's  Technical  Support  Directorate. 

NEW  SYSTEMS  DEVELOPMENT  WORK 


Criteria  for  contracting  new  development  work  for  each  step  in  the  system 
development  process  are  as  follows: 

-  Conceptual  Analysis  Criteria  (Appendix  A-l-1).  This  set  of  criteria 
focuses  on  the  essential  question  whether  the  system  to  be  developed 
is  to  utilize  new  hardware  or  software  approaches  and  technologies, 
outside  the  current  capabilities  of  the  DSAC  staff.  Often,  a  con¬ 
tractor  can  supply  a  "leading  edge”  approach  and  has  had  experience  in 
installing  systems  which  have  used  it. 

-  Functional  Analysis  Criteria  (Appendix  A-l-2).  Here,  the  key  cri¬ 
terion  is  whether  the  inputs  and  outputs  of  the  system  or  application 
to  be  designed  are  "stand  alone,"  i.e.,  whether  they  are  not  dependent 
upon  other  systems  to  the  extent  that  other  systems  must  be  modified 
to  accept  the  features  of  the  new  system. 
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"  Systems  Analysis  Criteria  (Appendix  A-l-3).  Two  major  criteria  are 
applicable  in  this  step:  (1)  whether  or  not  extensive  coordination 
between  the  contractor  and  more  than  one  DLA  organization  is  required 
and  (2)  whether  or  not  the  systems  interfaces  described  in  the  func¬ 
tional  analysis  criteria  (above)  have  been  identified  and  those  inter¬ 
faces  are  simple  and  few. 

-  Program  Analysis  Criteria  (Appendix  A-l-4).  Special  emphasis  is 
placed  on  the  functional  or  application  knowledge  of  the  designer 
during  this  step  of  development.  The  program  analysis  step  is 
critical  to  the  proper  execution  of  a  system,  and  in  addition  to 
adequate  functional  design  documentation,  programming  analysts  (in¬ 
ternal  to  DSAC  or  contractor-supplied)  should  have  solid  knowledge  and 
experience  in  the  functional  aspects  of  the  system  to  be  programmed. 

•  Programming  and  Program  Documentation  Criteria  (Appendix  A-l-4). 

Given  well  defined  programming  specifications,  programming  work  can  be 
performed  by  organizations  other  than  DSAC  without  great  risk.  The 
key  criterion  for  contracting  programming  work  to  outside  contractors, 
therefore,  is  provision  of  adequate  specifications. 

Underlying  the  criteria  described  for  each  of  the  systems  development 
steps,  above,  are  additional  criteria  which  address  the  sufficiency  and  ex¬ 
pertise  of  DSAC/contractor  staffs,  the  size  of  the  effort  to  be  contracted, 
and  the  lead-time  required  to  accomplish  the  development  effort  (see  Appendix 
A-l-5).  Specifically  considered  is  DSAC's  staffing  level  to  perform  the 
development  work  under  consideration,  the  special  skills  of  contractors  re¬ 
quired  to  perform  the  work,  the  minimum  number  of  workload  hours  which  can  be 
economically  contracted  to  an  outside  organization,  and  the  time  required  to 
contract  work  competitively  to  those  organizations  including  elapsed  time 
required  for  advertisement,  RFP  development,  contractor  response,  evaluation 
and  negotiation. 

SYSTEMS  MAINTENANCE  WORK 

Criteria  for  contracting  systems  maintenance  work  to  outside  organiza¬ 
tions  are  organized  according  to  (1)  the  definition  of  the  work  to  be  per¬ 
formed,  (2)  its  complexity  and  its  criticality  to  a  system's  ongoing  operation 
and  (3)  the  DSAC  and  contractor  resources  available.  Appendix  A-2  more  fully 


describes  the  criteria  and  their  use.  Their  major  elements  and  applications 


are: 

-  Work  Definition.  Development  work  should  be  screened  £or  appropriate* 
ness  for  outside  contracting.  For  example,  DSAC  management  functions 
such  as  project  supervision  and  coordination  are  not  considered  to  be 
contractible  despite  their  current  inclusion  in  DSAC  project  work* 
loads.  Moreover,  project  task  work  should  amount  to  more  than  40 
workload  hours  for  economical  contracting  to  outside  organizations. 
Task  objectives  as  well  as  outputs  and  inputs  should  also  be  well 
defined  and  documented. 

-  Work  Complexity,  Criticality.  Systems  maintenance  tasks  requiring 
extensive  changes  to  existing  master  files  which  serve  many  applica¬ 
tions,  or  where  change  logic  itself  is  extensive  and  complex,  are 
generally  unsuitable  to  be  contracted  to  outside  organizations.  In 
addition,  tasks  that  interact  heavily  with  in-process  redesign  work 
should  not  be  assigned  to  outside  organizations.  Moreover,  systems  to 
be  tested  on  the  ADTODIN  or  DLA  telecommunications  networks  should  not 
be  contracted  to  outside  organizations  until  they  become  familiar  and 
experienced  with  these  networks. 

-  Resources .  Contractors  should  perform  systems  maintenance  work  only 

when  DSAC  staff  is  not  available  to  perform  it.  Contractor  capabil¬ 
ity,  both  functional  and  technical,  is  also  required  for  effective  and 
efficient  performance  of  systems  maintenance  work. 

TECHNICAL  ASSISTANCE 

There  are  two  general  types  of  criteria  for  contracting  DSAC  telecommuni¬ 
cations  and  technical  support  development  functions.  One  type  addresses  the 
definition  and  scope  of  the  work  to  be  performed.  The  other  addresses  the 
resources  and  timing  required  to  accomplish  the  development  effort.  The 
following  are  key  criteria  considerations  for  contracting  out  DSAC  technical 
assistance  work.  Appendix  A-3  provides  a  detailed  description/procedure  for 
applying  the  criteria. 

-  Technical  Assistance  Work  Definition,  Scope.  The  criteria  developed 
address  the  definition  of  the  assistance  to  be  provided,  as  well  as 
the  extent  and  complexity  of  technical  coordination  required  to  de¬ 
velop  telecommunications  and  technical  support  hardware  and  software 
concepts  among  DSAC  users  and  other  government  agencies/organizations. 

-  Technical  Assistance  Resources,  Timing.  The  criteria  address  the 
sufficiency  of  the  DSAC  staff,  the  special  technical  expertise  re¬ 
quired  for  the  task  under  consideration,  the  possibility  of  adding  the 
task  to  an  existing  technical  assistance  contract,  the  lead-time  and 
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level  of  effort  required  to  perform  the  tas 
obtaining  this  type  of  assistance  through  a 
arrangement  with  the  outside  firm. 


III.  ANALYSIS  RESULTS 


The  contract  support  criteria  described  in  the  preceding  section  were 
tested  on  the  backlog  of  project  work  at  DSAC,  which  includes  systems  develop¬ 
ment  project  work  and  current  planned  workloads  (Systems  Change  Requests,  or 
SCR's).  The  results  of  those  tests  are  presented  in  this  report  section. 
Also  included  is  a  review  of  the  use  of  development  contractors  by  DoD  Central 
Design  Activities  (CDA's),  and  a  review  of  productivity  improvement  techniques 
in  use  at  the  CDA's  and  DSAC. 

USE  OF  CONTRACTORS  FOR  NEW  SYSTEMS  DEVELOPMENT  PROJECTS 

The  criteria  were  tested  on  major  systems  development  projects  and  sup¬ 
port  activities  planned  for  future  development  and  implementation  in  the  DSAC 
Directorates  of  Materiel  Management,  Subsistence  Management,  Depot  Management, 
Technical  Support  and  Telecommunications.  Those  projects  and  activities  are 
identified  and  described  in  the  1980  DLA  Master  Automatic  Data  Processing  Plan 
(DMAP) . 

Exhibit  III-l  is  a  summary  of  the  results  of  the  test.  It  shows  that 
approximately  371,000  hours,  or  34%,  of  the  project  workload  for  the  Materiel 
Management,  Subsistence  Management,  and  Depot  Management  Directorates  fully 
meet  the  criteria  for  contracting  that  work  to  outside  systems  development 
organizations.  Another  58,000  hours,  or  5%,  are  "possibly"  contractible — the 
work  does  not  meet  all  the  criteria,  but  meets  a  sufficient  number  of  them  to 
warrant  further  consideration  for  placing  it  with  outside  organizations. 

Appendix  B  lists  all  the  projects  to  which  the  criteria  have  been  applied 
and  provides,  in  addition  to  an  accounting  of  those  hours  which  are  estimated 
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4  projects  appear,  in  part,  contractible. 


to  be  contractible  and  those  which  are  not,  a  description  of  the  type  of  work 
which  is  contractible,  and  reasons,  where  applicable,  for  non-contractibility. 
Reasons  for  non-contractible  work  are  cross-referenced  to  the  criteria 
described  in  Appendix  A. 

In  general,  the  opportunities  for  contracting  work  to  outside  organi¬ 
zations  in  these  Directorates  are  as  follows: 

-  Materiel  Management,  Subsistence  Management--projects  most  contracti¬ 
ble  are  those  to  develop  subsistence  applications  and  convert  them  to 
the  Standard  Automated  Materiel  Management  Systems  (SAMMS). 

-  Depot  Management — the  work  to  develop  the  DoD  Standard  Warehousing  and 
Shipping  Automated  System  (DWASP)  is  most  contractible. 

In  all  of  the  Directorates,  the  most  contractible  activities  are  appli¬ 
cation  programming,  program  testing  and  program  documentation.  Some  smaller 
projects,  however,  such  as  the  CONUS  Transportation  Bid  Evaluation  project, 
and  the  Master  Equipment  Control  System  (See  Appendix  B)  are  contractible  in 
their  entirety. 

Exhiuit  III-l  also  shows  that  38%  of  the  DSAC's  Technical  Support 
Directorate  functions,  and  43%  of  its  Telecommunications  Directorate  functions 
meet,  at  least  in  part,  the  criteria  for  contracting  their  work  to  outside 
organizations.  Appendix  C  provides  a  detailed  listing  of  those  functions  and 
an  analysis  of  the  contractibility  of  each. 

SYSTEM  CHANGE  REQUEST  (SCR)  CONTRACTIBILITY 

A  stratified  sample  of  134  SCR's  (representing  10%  of  the  total  number  of 
SCR's  and  60%  of  the  estimated  hours  to  complete  SCR  project-related  work)  was 
drawn  and  was  analyzed,  after  applying  the  criteria  for  contracting  to  outside 


^Subsequent  to  the  analysis  phase  of  this  stud’  ,  DLA  decided  to  develop  a 
new  subsistence  system  and  not  convert  existing  subsistence  systems  to  SAMMS. 
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organizations  to  each.  Each  task  was  then  reviewed  with  DSAC  Directorate 
branch  chiefs  in  order  to  further  determine  the  contractibility  of  the  tasks 
and  to  refine,  thereby,  the  criteria  themselves. 

The  results  of  this  analysis  and  review,  displayed  in  Exhibit  III-2  are 
summarized  as  follows:  (SCR  analysis  detail  is  provided  in  Appendix  D.) 

-  Overall,  only  14.5%  or  approximately  96,500  hours  of  SCR  work  qualify 
for  contracting  to  outside  organizations.  Of  this  amount,  5.1%  or 
approximately  34,000  hours  qualify  for  contracting  on  a  task  order 
basis.  This  is  because  the  size  of  the  individual  work  packages  is 
small  (each  is  less  than  2,000  hours).  The  remaining  9.4%  of  con¬ 
tractible  work  can  be  procured  on  a  project-by-project  basis. 

-  Approximately  53,500  hours  of  the  Materiel  Management  Directorate's 
workload  are  contractible.  Most  of  that  work  is  for  development  of 
new  programs  within  current  systems.  There  is  also  a  significant 
amount  of  the  Subsistence  Management  Directorate's  project  work — 
approximately  28,500  hours--suitable  for  contracting  to  outsiders. 
Most  of  this  work  can  be  procured  on  a  project-by-project  basis. 

-  There  is  little  (only  4.4%)  contractible  work  in  the  Depot  Management 
Directorate,  because  the  bulk  of  the  current  effort  is  undefined,  and 
because  there  are  functional  design  tasks  (related  to  DWASP)  which 
require  DSAC  design  staff  capabilities. 

-  Very  little  SCR  work  in  Technical  Support  and  Telecommunications  was 
found  to  be  contractible  because  the  tasks  are  regarded  as  management 
or  administrative,  which  cannot  be  contracted  to  outsiders,  or  the 
tasks  are  not  defined  well  enough  to  fully  determine  contractibility. 

Exhibit  III-3  is  a  tabulation  of  the  "reasons"  for  non-contractibility  of 
DSAC  SCR's.  This  tabulation  shows  that  two  reasons  account  for  54%  of  the 
hours  which  are  not  contractible:  the  design  work  to  be  performed  requires 
extensive  internal  functional  systems  knowledge  (30%) ,  and  the  task  effort 
itself  is  too  complex  (24%)  to  be  accomplished  economically  by  outside 
companies . 

CPA  USE  OF  OUTSIDE  CONTRACTORS 

One  aspect  of  our  analysis  of  the  possible  use  of  systems  development 
contractors  to  perform  DSAC  systems  development  work  included  a  review  of  past 
work  performed  by  contractors  for  other  DoD  central  design  activities  (CDA's) 


EXHIBIT  III- 


*See  Exhibit  III-3A  definitions  of  criteria  categories. 
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Operational  test  environment  AUTODIN,  DLA  telecommunications  network,  or  operational 

required  system  access  required. 


and  other  federal  government  agencies.  The  objectives  of  the  review  were  to 
compare  the  extent  and  kind  of  DSAC's  use  of  outside  contractors  to  that  of 
the  other  CDA's,  and  as  a  result  of  the  comparison,  identify  possible  new  op¬ 
portunities  for  DSAC  to  contract  its  development  work. 

Exhibit  III-4  provides  a  comparison  of  the  use  of  contractors  by  DoD  for 
application  systems  and  for  other  uses  such  as  computer  configuration 
analysis,  training,  and  software  development.  From  this  comparison,  it  can  be 
seen  that  contractors  have  been  used  by  the  CDA's,  including  DSAC,  in  a  wide 
range  of  application  development  activities  including  turnkey  systems  develop¬ 
ment  and  maintenance,  software  conversion  activities,  programming  and  pro¬ 
gramming  documentation,  programming  specifications,  data  base  design,  and 
prototype  applications  development  and  testing. 

While  DSAC  appears  to  compare  favorably  with  other  CDA's  in  contracting 
documentation  activities,  application  analysis  activities,  franchised  system 
development  and  maintenance,  configuration  analysis  and  training  to  systems 
developers  and  vendors,  other  CDA's  have  made  more  extensive  use  of  systems 
software  development  than  has  DSAC.  They  are  also  using  contractors  for  the 
development  of  minor,  stand-alone  application  systems. 

Neither  the  CDA's  reviewed  nor  DSAC,  however,  have  contracted  out  the 
development  and/or  maintenance  of  their  major  systems  efforts.  On  the  other 
hand,  of  DLA  headquarters  and  the  ''civilian”  agencies  reviewed,  all  had  con¬ 
tracted  major  systems  development  efforts.  One  agency  now  contracts  its 
entire  central  design  activity  to  two  commercial  systems  development  com- 
panies--one  company  is  assigned  exclusive  responsibility  for  systems  develop¬ 
ment,  the  other  for  maintenance.  Our  review  and  discussions  with  people  in 
these  organizations  with  regard  to  the  feasibility  and  appropriateness  of  con¬ 
tracting  out  major  system  work  to  outside  organizations  led  us  to  conclude 


USE  OF  CONTRACTORS  BY  DoD  CENTRAL  DESIGN  ACTIVITIES 


that  there  are  many  opportunities  for  DSAC  to  do  the  same.  This  conclusion  is 
supported  by  the  results  of  our  analysis  of  DSAC  projects  applying  the 
criteria  developed  for  necessary  contracting-out  decisions. 

DSAC  PRODUCTIVITY  IMPROVEMENT 


Concurrent  with  the  review  of  the  use  of  development  contractors  by  CDA's 
and  other  agencies,  a  review  of  the  use  of  systems  development  "productivity 
tools"  was  undertaken.  Exhibit  I I 1-5  displays  and  describes  the  status  of  the 
data  base  management  system  (DBMS),  programmer  dictionaries,  COBOL  transla¬ 
tors,  structured  design,  etc.,  in  use  at  DSAC  and  the  other  CDA's.  From  this 
analysis,  together  with  a  review  of  the  use  made  of  these  tools  in  other 
government  agencies  and  commercial  systems  development  organizations,  we 
conclude  that: 

-  One  of  the  most  effective  productivity  steps  to  be  taken  by  DSAC  is 
that  of  upgrading  the  capacity  and  throughput  of  its  test  facility 
computers  for  on-line  programming;  program  compiling. 

-  While  DSAC  has  used  its  internally-developed  SAMTAM  and  MOTAM  data 
base  management  systems,  and  is  implementing  a  commercial  DBMS  (TOTAL) 
for  existing  and  planned  applications,  further  use  of  DBMS's  is  indi¬ 
cated  to  avoid  the  development  expense  involved  in  enhancing  "home 
grown"  systems  and  to  take  full  advantage  of  the  features  of  more 
recently  developed  systems.  Moreover,  we  believe  these  DBMS's  should 
be  implemented  in  new,  on-line  systems,  rather  than  fitted  into 
existing,  batch-oriented  system  environment. 

-  While  DSAC  has  used  a  significant  number  of  systems  management,  design 
and  testing  tools,  more  advanced  tools  could  be  used.  We  believe  DSAC 
should  investigate  further  the  use  of  application  generators,  applica¬ 
tions  prototyping,  data  base  design  packages  (described  above),  and, 
in  particular,  the  use  of  the  Problem  Statement  Language/Problem 
Statement  Analyzer  (PSL/PSA)  package. 
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IV.  CONCLUSIONS  AND  RECOMMENDATIONS 


The  following  conclusions  and  recommendations  for  contracting  DSAC  devel- 

\ 

opment  work  result  from  our  developing,  reviewing,  and  testing  the  criteria 
for  contracting  DSAC  systems  development  workloads,  and  reviewing  other  organ¬ 
izations'  contracting  practices  and  productivity  improvement  measures. 

Overall,  we  believe  the  criteria  developed,  reviewed,  and  refined  with 
DSAC,  DLA,  and  CDA  personnel  and  other  government  and  commercial  organization 
personnel  will  effectively  identify  DSAC  systems  development  work  that  can  be 
successfully  accomplished  by  outside  contractors.  We  further  believe  that  the 
criteria  developed  meet  the  requirement  of  "minimal  risk",  i.e.,  they  minimize 
the  risk  of  problems  which  can  occur  with  contractor-developed  systems,  par¬ 
ticularly  those  related  to  the  potential  lack  of  contractor  functional  design 
expertise  and  to  the  appropriateness  of  the  work  itself  for  contracting,  in¬ 
cluding  its  definitiveness,  complexity,  and  criticality  to  other  DLA  systems 
and  processes. 

Other  conclusions  and  recommendations  follow. 

CONCLUSIONS 

1.  Of  all  DSAC  development  activities  reviewed,  the  programming 
activity  is  the  one  most  contractible  to  outside  development 
organizations . 

2.  Because  the  conceptual  design  activity  is  the  most  critical  to 
the  life  of  the  system  to  be  developed,  and  because  systems 
development  (hardware  and  software)  technology  continues  to 
develop  and  advance  at  an  extremely  accelerated  rate,  it  is  im¬ 
portant  for  DSAC  to  take  advantage  of  "leading-edge"  concepts 
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in  systems  development.  These  concepts  are  most  readily  pro¬ 
vided  by  development  organizations  with  expertise  and  experi¬ 
ence  in  conceptual  systems  design. 

Because  of  the  relative  high  complexity  of  DLA's  logistics 
information  systems,  particularly  subsistence,  materiel  manage¬ 
ment  and  distribution  systems,  the  contracting  of  the  func¬ 
tional  analysis  and  specification  activities  for  these  systems 
to  outside  organizations  is  not  indicated.  DSAC  personnel,  who 
are  well  qualified  and  experienced  in  the  development  of  these 
systems,  are  needed  to  guide  their  design  in  response  to  DLA 
user  requirements. 

There  appears  to  be  little  opportunity,  in  the  short  run,  for 
contracting  systems  maintenance  work  to  outside  organizations. 
From  the  analysis  and  review  undertaken  in  the  technical  as¬ 
sistance  directorates  of  Telecommunications  and  Technical 
Support,  it  is  concluded  that  there  are  a  significant  number  of 
functions  in  these  directorates  with  potential  for  contractor 
assistance. 

Because  of  the  substantial  amount  of  work  determined  to  be 
eligible  for  contracting  to  commercial  systems  development 
organizations  (more  than  525,000  hours  of  DMAP  and  SCR  work¬ 
load),  there  is  a  need  for  DSAC  to  establish  a  contract  co¬ 
ordinating  office  to  assist  systems  and  technical  staffs  in 
contracting  work  to  those  organizations. 

DSAC's  internal  systems  development  productivity  can  be  sig¬ 
nificantly  increased  by  the  addition  of  adequate  computing 
equipment  (additional  capacity  and  throughput  capability)  for 


programming  and  testing  computer  applications.  In  addition  to 
utilizing  advanced  DBMS’s,  application  generators,  applications 
prototyping,  and  the  PSL/PSA  software  package,  DSAC  needs  to 
upgrade  its  development,  design,  and  documentation  standards  in 
order  to  take  advantage  of  these  and  other  new  design  concepts 
and  technologies. 

RECOMMENDATIONS 

In  line  with  the  foregoing  conclusions,  the  following  steps  for 
tracting  workloads  and  improving  productivity  are  recommended. 

1.  It  is  recommended  that  DSAC  and  DLA  Headquarters  staff  proceed 
to  a)  identify  the  specific  programming  workload  they  desire  to 
be  assigned  to  contract  programming  organizations  (from  the 
recommended  project  workload  lists  in  Appendices  B,  C,  and  D), 
b)  identify  qualified  contractors,  and  c)  prepare  work  state¬ 
ments  for  inclusion  in  requests  for  proposals  to  be  issued  for 
competitive  bidding. 

2.  It  is  recommended  that  DSAC  and  DLA  identify  (from  the  list  in 
Appendix  B)  conceptual  design  work  in  major  system  and  subsys¬ 
tem  development  projects  where  current  DSAC  systems  technology 
is  viewed  as  less  than  up-to-date.  Specifically,  the  con¬ 
ceptual  analysis  for  the  new  subsistence  system  should  be  con¬ 
sidered,  as  well  as  the  effort  to  develop  a  new,  on-line  SAMMS. 

3.  In  order  to  assure  conformity  in  systems  design  to  user  re¬ 
quirements,  DSAC  functional  analysis  groups  should  continue  to 
develop  and  produce  functional  design  specifications  and  act  as 
contract  officer's  technical  representatives  (COTR’s)  for 
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conceptual  design  of  entire  new  systems  by  outside  development 
organizations . 

4.  It  is  recommended  that  DSAC  systems  design  and  programming 
staff  continue  to  modify,  effectively  and  economically,  the 
systems  currently  in  place  with  DLA  users.  We  also  recommend 
the  use  of  that  staff  to  maintain  the  new  systems  developed  by 
contractors,  in  order  to  assure  that  systems  development  and 
maintenance  do  not  become  "locked  in"  to  an  outside  con¬ 
tractor's  organization. 

5.  In  order  to  take  full  advantage  of  contractor  assistance  in  the 
telecommunication  and  technical  support  functions,  we  recommend 
that  DSAC  review  current  project  plans  and  the  recommendations 
for  contracting  to  outside  organizations  in  Appendix  C  to 
identify  specific  workloads/projects  to  be  contracted. 

6.  With  the  assistance  of  DLA  headquarters,  DSAC  should  establish 
a  contract  coordinating  office  under  a  DSAC  administrative 
organization,  such  as  DSAC's  Office  of  Planning  and  Management. 

7.  We  recommend  that  DSAC  undertake  a  feasibility  study  to  deter¬ 
mine  the  best  strategy  for  upgrading  computer  capacity  and 
throughput  (for  the  computer  maintenance  and  peripheral  equip¬ 
ment)  in  order  to  increase  productivity  in  DSAC's  programming 
design  and  test  activities.  We  also  recommend  that  DSAC  ini¬ 
tiate  a  research  program  to  identify  and  test,  on  a  continuing 
basis,  new  development  methodologies.  Application  generators 
and  automated  design  tools  should  be  investigated  immediately, 
in  addition  to  identifying  and  testing  new  DBMS's.  It  is  also 
recommended  that  the  Center  update  its  standards  for  the  use  of 
new  programming  languages  and  applications  systems. 
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A-2.  Systems  Maintenance 
A-3.  Technical  Assistance 
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NEW  SYSTEMS  DEVELOPMENT 


The  following  are  the  criteria,  in  flow  diagram  form,  for  making  contract 
support  decisions  for  new  systems  development  work.  These  criteria  are  used 
for  entirely  new  systems  development  work  or  the  rework  of  current  DSAC  systems, 
subsystems,  or  applications.  Criteria  for  the  systems  implementation  phase, 
e.g. ,  file,  data,  conversion  activities  of  a  development  project,  were  not 
developed  based  on  the  assumption  that  DSAC  would  assume  complete  responsibility 
for  this  project  phase. 

Explanatory  notes  accompany  the  diagrams  (pages  A- 1-6,  A- 1-7). 


1.  CONCEPTUAL  ANALYSIS 


1.1  Define  Objectives 


1.2  Is  the  effort  to  develop 
or  redevelop  a  system  or 
subsystem? 


1.3  Does  the  effort  involve 
new  technology  or  a  new 
application  area? 


1.4  Justify  contracting. 


1.5  Is  contracting  indicated? 


1.6  Action 
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2.1  Are  functional  manage¬ 
ment  requirements 
clearly  stated? 


SYSTEMS  ANALYSIS 


3.1  Do  related  efforts/co¬ 
ordination  problems 
exist? 


3.2  Are  the  interfaces  to 
be  specified  few  and 
identified? 


3.3  Justify  contracting. 


3. A  Is  contracting  indicated? 


3.5  Action 


PROGRAM  ANALYSIS 


4.1  Justify  contracting. 


4.2  Is  contracting 
indicated? 


4.3  Action 


5.  PROGRAMMING  AND  PROGRAM  DOCUMENTATION 


5.1  Justify  contracting. 


5.2  Is  contracting 
indicated? 


5.3  Action 


6.  JUSTIFICATION  ROUTINE 


6.1  Is  DSAC  staff 
sufficient? 


6.2  Is  special  technical 
expertise  needed, 
cost  justified? 


6.3  Do  potential  con¬ 
tractors  have  expertise 
required? 


6.4  Is  the  level  of  effort 
at  east  2000  hours? 


6.5  Is  there  sufficient 
time  to  contract 
competitively? 


6.6  Can  the  effort  be  "sole- 
sourced"  on  existing 
or  new  contract? 


6.7  Action 


FLOW  DIAGRAM  NOTES,  NEW  SYSTEMS 

DEVELOPMENT  CRITERIA 

Criteria  Pro- 

cedure  Step  _ Notes /Remarks _ 

1.1  System  requirements,  objectives  should  be  defined  (in¬ 
cluding  automation  requirements).  Development  project 
completion  time  is  a  must.  See  Section  4.1,  FIPS  PUB  64 
for  guidance  in  defining  objectives,  requirements. 

1.2  Conceptual  analysis  should  be  undertaken  when  a  major 
system  or  subsystem  is  to  be  developed.  Applications  may 
not  require  a  ’’full-blown"  conceptual  design  analysis 
effort. 

1.3  Any  "new"  development  activity  to  DSAC  (application  design, 
hardware  configuration,  communication  network,  etc.). 

Only  contractors  with  an  implementation  "track  record" 
should  be  used. 

1.4  The  "justification  routine,"  common  to  all  new  development 
criteria.  Addresses  contractibility  from  a  staffing, 
technical  expertise,  economic  and  project  leadtime  require¬ 
ment  view. 

1.5  Decision  dependent  on  results  of  the  "justification 
routine. " 

1.6  If  work  to  be  performed  does  not  involve  a  major  redesign 
effort  (small,  application  level  work)  or  does  not  involve 
major  advance  in  software  or  computer  hardware  technology, 
conceptual  design  work  is  probably  not  indicated,  or  could 
be  included  as  part  of  the  functional  design  effort  for 
the  entire  system  to  be  developed. 

2.1  Includes  user  objectives,  requirements  and  major  processes 
including  data  flows,  input  and  output  specification. 

2.2  Our  discussions  with  DSAC  staff  have  produced  the  follow¬ 
ing  definition  of  a  "stand-alone"  system:  a  system  "stands 
alone"  and  hence,  is  contractible  to  outside  organizations 
when  its  inputs  and  outputs  can  be  and  are  specified 
during  the  functional  analysis  phase  of  a  development 
project.  If  their  definition  must  be  deferred  until  the 
systems  design  phase  of  the  project,  because  of  parallel 
design  efforts  which  will  affect  the  system,  a  stand-alone 
situation  does  not  exist,  and  hence,  contracting  the 
effort  should  not  be  undertaken. 
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Criteria  Pro- 

cedure  Step  _ Notes /Remarks 


2.4  Decision  dependent  on  results  of  the  "justification  routine." 

3.1  Parallel  development  efforts,  such  as  the  effort  to  select 
a  DBMS  in  support  of  the  system  or  application  under 
review,  would  mitigate  against  contracting  the  applications 
development  work  to  outsiders. 

3.2  All  inputs  and  outputs  not  fully  defined  in  the  functional 
specification  should  be  few  (less  than  10%  of  all  inputs/out¬ 
puts).  As  a  minimum,  they  should  be  identified  and  briefly 
described  in  the  functional  specification. 

6.1  Adequate  numbers  of  DSAC  staff  should  be  available  to 
complete  the  work  within  the  time  required  by  the  user. 

6.2  Pertains  to  all  kinds  of  expertise:  functional,  design, 
systems  design,  programming  design,  programming,  hardware, 
telecommunications,  etc. 

6.3  Contractors  should  have  a  "hierarchy  of  skills"  capability: 
in  order  to  perform  program  or  systems  analysis  activities 
well,  functional  knowledge  of  the  systems  to  be  developed 
is  required,  in  addition  to  programming  and  hardware 
knowledge. 

6.4  Less  than  2000  hours  of  effort  for  any  single  development 
contract  would  prove  uneconomical  to  both  DSAC  and  the 
contractor. 

6.5  Contracting  competitively  involves  time  to  be  provided  RFP 
development,  bidder  response,  DSAC  evaluation  and  contract 
negotiation.  Programming  contracts  could  probably  be 
obtained  in  six  months.  Major  systems  procurements  could 
take  as  long  as  nine  months. 

6.6  If  sole-source  contracting  can  be  justified  and  DSAC  has 
an  existing  vendor  contract  (level  of  effort)  to  which  the 
work  under  consideration  could  be  added,  then  a  contract 
effort  on  a  sole-source  basis  is  indicated. 
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SYSTEMS  MAINTENANCE 


The  following  are  the  criteria  for  contract  support  for  system  mainte¬ 
nance  tasks.  It  is  assumed  that  a  level-of-ef fort  contract /basic  ordering 
agreement  can  be  obtained  for  on-site  contractor  support  for  systems  mainte¬ 
nance  work. 

Criteria  are  more  fully  described  in  the  accompanying  notes  (page  A-2-4) . 


1.  WORK  ELIGIBILITY 


1 . 1  Does  the  work  involve  management 
functions? 


1.2  Is  the  task  active,  and  more 
than  40  hours? 


1.3  Is  the  work  well  defined? 
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WORK  COMPLEXITY.  CRITICALITY 


2.1  Are  master  file  changes 
required? 


2.2  Is  more  than  one  sub¬ 
system  involved? 


2.3  Are  complex  logic  changes 
involved? 


2.4  Are  changes  to  large  or 

critical  programs  required 


2.5  Are  ten  or  more  programs 
involved? 


2.6  Are  programs  currently 
being  changed  by  DSAC 
involved? 


2.7  Are  changes  to  DSAC  de¬ 
veloped  system  software 
required? 


2.8  Is  access  to  AUTODIN,  DLA 
network,  operational  sys¬ 
tem  required  to  test? 
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Criteria  Pro- 

cedure  Step  _ Notes/Remarks _ 

1.1  Includes  the  management  activities  of  project  coordination, 
supervision  and  DSAC  representation  which  would  not  nor¬ 
mally  be  contracted  to  a  commercial  organization. 

1.2  Tasks  expected  to  be  on  "hold"  status  (PMS)  for  more  than 
30  days  should  not  be  considered.  For  maintenance  work, 
less  than  one  person-weeks  is  not  economical  to  assign  to 
an  outside  organization,  even  on  a  level-of-effort  contract 
basis. 

2.1  Files  common  to  many  applications  should  be  maintained  by 
DSAC  staff. 

2.2  When  changes  affect  more  than  one  subsystem,  it  is  diffi¬ 
cult  to  manage  the  change  process. 

2.3  Certain  changes  involve  highly  complex  functional  logic 
which  should  not  be  changed  by  contractor  personnel. 

2.4  Critical  programs  are  those  which  involve  mainstream 
processing,  i.e.  ,  many  or  all  transactions  are  processed 
even  through  a  jobstream. 

2.5  When  large  numbers  of  programs  are  changed  simultaneously, 
management  of  the  change  process  is  unwieldy. 

2.6  Contracting  to  outsiders  would  cause  coordination  problems, 

under  these  circumstances. 

2.7  Special  experience  or  learning  required  to  modify  these 

systems:  DSAC  staff  only. 

2.8  Security  considerations. 

3.3  Task  must  match  existing  scope  of  work. 
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TECHNICAL  ASSISTANCE 

The  following  are  the  criteria  for  evaluating  technical  assistance  con- 
tractibility. 

Criteria  are  further  described  in  the  accompanying  notes  (page  A-3-3). 


1.  TYPE  OF  WORK  LIMITATIONS 


1.1  Is  work/deliverable  well 
defined? 


1 . 2  Does  the  work  relate  only 
to  DSAC  management  tasks? 


1 . 3  Does  the  work  require  man¬ 
agement  coordination  with 
other  DSAC  Directorates? 


1.4  Does  the  work  require 
direction  of  government 
personnel? 


1.5  Does  the  work  require  rep¬ 
resenting  DSAC  in  inter¬ 
agency  activities? 
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2 .  JUSTIFICATION 


2.1  Is  DSAC  staff  sufficient? 


2.2  Is  special  technical 

expertise  needed  or  cost- 
justified? 


2.3  Do  potential  contractors 
have  expertise  required? 


2.4  Can  the  effort  be  "sole 
sourced"  on  existing  or 
new  contract? 


2.5  Is  there  sufficient  time 
to  contract  competitively? 


2.6  Is  the  level  of  effort  at 
least  2000  hours? 


2.7  Will  similar  tasks 
occur  within  a  year? 


2.8  Action 


FLOW  DIAGRAM  NOTES,  TECHNICAL 
ASSISTANCE  CRITERIA 

Criteria  Pro- 

cedure  Step  _ Notes /Remarks _ 

!,  1.3  See  step  1.1,  Appendix  A-2. 

L.4  A  pitfall  for  technical  assistance  work:  contractors  not 

to  direct  DSAC  personnel  in  project  work. 

l.5  Contractor  responsibility  for  interagency  AUTODIN,  ADPER 

projects  should  be  discouraged. 

!.7  Forecast  of  similar  work  needed  to  determine. 
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CRITERIA  APPLIED  TO  DMAP  PROJECTS 


DSAC's  1980  DMAP1  plan  was  reviewed  to  identify  projects  within  the  DSAC 
Materiel  Management,  Subsistence  Management,  and  Depot  Management 
Directorates.  More  recent  major  systems  development  projects  were  also  in¬ 
cluded  via  information  provided  by  DSAC  and  DLA  Headquarters  management 
personnel . 

Estimates  of  the  amount  of  development  effort  required  by  project  stage 
were  assigned  to  each  project  as  follows: 


Project  Stage 

Functional  Analysis 
Systems  Analysis 
Program  Analysis 
Programming 


Est.  Amount  (%) 
of  Effort  Required 

30% 

20% 

20% 

30% 


100% 


These  percentages  are  based  on  the  proportion  of  DSAC  staff  assigned  to 
project  functions.  They  were  reviewed  and  validated  with  DSAC  management 
personnel. 


^LA  Master  Automatic  Data  Processing  Plan,  Section  IV,  Central  Design 
Activity-DSAC ,  June  1980. 
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APPENDIX  C 


CRITERIA  APPLIED  TO  TECHNICAL  ASSISTANCE  FUNCTIONS 


The  1980  DMAP  plan  of  DSAC  does  not  list  projects  for  the  Telecommuni¬ 
cations  and  Technical  Support  Directorates.  Instead,  it  lists  "objectives," 
or  the  activities  which  support  other  development  functions.  The  following 
chart  lists  those  functions  and  displays  our  analysis  of  their 
contractibility. 


CONTRACTING  DSAC  TECHNICAL  SUPPORT  OBJECTIVES 
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APPENDIX  D 


CRITERIA  APPLIED  TO  SYSTEM  CHANGE  REQUESTS 


SAMPLE  DESIGN 


System  Change 

Requests  in  five 

DSAC  directorates  were 

sampled  using  a 

stratified  random  sampling  technique. 

The  table 

below  shows 

sample  and  popu- 

lation  data. 

Remaining 

Total 

Directorate 

//SCRs 

Hours 

Hours 

Materiel  Management 

Population 

874 

177,781 

290,585 

Sample 

72 

86,815 

135,450 

Subsistence  Manage¬ 

Population 

109 

66,586 

109,254 

ment 

Sample 

13 

58,075 

82,034 

Depot  Management 

Population 

128 

45,865 

128,806 

Sample 

24 

36,785 

104,543 

Technical  Support 

Population 

111 

39,347 

90,341 

Sample 

17 

22,721 

74,204 

Telecommunications 

Population 

67 

15,995 

65,838 

Sample 

8 

3,749 

8,316 

Totals 

Population 

1289 

345,574 

684,824 

Sample 

134 

207,875 

404,547 

(10.4%) 

(60. 

2%)  (59 . 1%) 

Estimates  of  the  amount  of  development  effort  required  by  project  stage 
were  assigned  as  follows: 

Est.  Amount  (%) 

Project  Stage  of  Effort  Required 


Functional  Analysis  - 

30% 

System  Analysis 

20% 

Program  Analysis 

20% 

Programming 

30% 

100% 


Exhibits  D-l  to  D-5  display  the  results  of  applying  the  criteria  to  the 
SCR  sample  for  the  following  five  DSAC  Directorates: 


Exhibit 

Directorate 

D-l 

Materiel  Management 

D-2 

Subsistence  Management 

D-3 

Depot  Management 

D-4 

Telecommunications 

D-5 

Technical  Support 

Information  Fields,  Exhibit  D 

Task  #  -  the  SCR  number  as  it  appears  in  Project  Management  System 

(PMS)  reports. 

Task  Name  -  the  SCR  Title  as  it  appears  in  PMS  Reports. 

ESTHRS  -  the  total  estimated  hours  appearing  on  the  PMS  listing 

sampled  (DSAC/M,  listing--7/10/81 ,  all  other  Directorates-- 
7/31/81). 

REMHRS  -  remaining  task  hours  (hours  sampled). 

CTR  -  Contract  potential,  as  indicated  by  the  following  codes  (as¬ 

signed  as  result  of  analysis): 

P  -  contractible  project  (may  combine  revisions). 

PP  -  possibly  contractible 

TO  -  Task  order — add  to  existing  contract 

PTO  -  possibly  contractible  task  order 

?  -  possibly  contractible,  but  work  undefined 

CTRHRS  -  The  number  of  ESTHRS  hours  determined,  as  a  result  of  the 
analysis,  to  be  contractible. 

CPT  -  The  contractible  portion  of  task: 

PA  -  Program  analysis  and  programming  portions 
PPA  -  Partial  program  analysis  and  programming  portions 

T  -  Total  task 

P  -  Programming  only 

PT  -  Partial  task,  planning  or  implementation  activity 

PROB  -  The  reasons  for  non-contractibility  (Appendix  A  criteria 

references) . 

FUNC  -  DSAC  functional  or  systems  expertise  required 
(A-l : 6.3,  A-2) 

BO  -  Blanket  order  task  (A-2: 1.3) 

DEF?  -  Work  not  fully  defined  (A- 1:2.1,  A-2:1.3) 

CMPLX  -  Complex  logical  changes  involved  (A-2: 2. 3) 


D-2 


INT  -  Interfaces  to  other  systems  involved  (A- 1:2. 2,  3.2; 
A-2:2.2) 

//TSK  -  Parallel  tasks  performed  by  DSAC  restrict  contracting 
(A-2-.2.6) 

CP  -  Critical  programs  involved  (A-2:2.4) 

MFC  -  Master  file  changes  required  (A-2:2.1) 

SUSP  -  Suspended  task  (A-2:1.2) 

CANC  -  Cancelled  task  (A-2:1.2) 

CSS  -  Changes  to  custom  DSAC  systems  software  required 
(A-2:2.7) 

MULTS  -  Multiple  subsystems  involved  (A-2:2.2) 

MGT  -  Management  functions  (A- 2: 1.1) 

TEST  -  Test  environment  involves  AUTODIN,  DLA  telecomminca- 
tions  network,  or  an  operational  system  (A-2:2.8) 

MANYP  -  Many  (ten  or  more)  programs  involved  (A-2:2.5) 

PART  -  Only  part  of  the  task  can  be  contracted  because 

DSAC  functional  or  systems  expertise  is  required  for 
the  other  part  (A- 1:6.3,  A-2) 

PRJHRS  -  Projected  hours  contractible  for  the  population  of  SCR's, 
computed  as  follows  for  each  SCR  sampled: 

For  the  Materiel  Management,  Subsistence  Management,  Technical 
Support  and  Telecommunications  Directorates, 

CTRHRS  ?  REMHRS  x  2000  =  SCR  Population 

Contractible  Hours 

where 


2000  =  the  number  of  population  hours  represented  by 
the  SCR  sampled. 

For  the  Depot  Management  Directorate, 

CTRHRS  r  REMHRS  x  1200  =  SCR  Population 

Contractible  Hours 

where 

1200  =  the  number  of  population  hours  represented  by 
the  SCR  sampled. 
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